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Abstract. Let k be a field and / be a Siegel modular form of weight h > and 
genus g > 1 over k. Using /, we define an invariant of the fc-isomorphism class 
of a principally polarized abclian variety (A, a)/k of dimension g. Moreover 
when (A, a) is the Jacobian of a smooth plane curve, we show how to associate 
to / a classical plane invariant. As straightforward consequences of these 
constructions when g = 3 and fccC we obtain (i) a new proof of a formula of 
Klein linking the modular form Xl8 to the square of the discriminant of plane 
quartics ; (ii) a proof that one can decide when (A, a) is a Jacobian over k by 
looking whether the value of X18 a t {A, a) is a square in k. This answers a 
question of J. -P. Serre. Finally, we study the possible generalizations of this 
approach for g > 3. 



1. Introduction 

1.1. Torelli theorem. Let k be an algebraically closed field. If X is a (nonsingular 
irreducible projective) curve of genus g over k, Torelli's theorem states that the 
map X i— > (JacAT, j), associating to X its Jacobian together with the canonical 
polarization j, is injective. The determination of the image of this map is a long 
time studied question. 

When g = 3, the moduli space A g of principally polarized abelian varieties of 
dimension g and the moduli space M g of nonsingular algebraic curves of genus g 
are both of dimension 3g — 3 = g(g + l)/2 = 6. According to Hoyt [H] and Oort 
and Ueno [25], the image of M 3 is exactly the space of indecomposable principally 
polarized abelian threefolds. Moreover if k = C, Igusa [T7] characterized the locus 
of decomposable abclian threefolds and that of hyperelliptic Jacobians making use 
of two particular modular forms £140 and xis on the Siegel upper half space of 
degree 3. 

Assume now that k is any field and g > 1. J. -P. Serre noticed in [22] that a precise 
form of Torelli's theorem reveals a mysterious obstruction for a geometric Jacobian 
to be a Jacobian over k. More precisely, he proved the following: 

Theorem 1.1.1. Let (A, a) be a principally polarized abelian variety of dimension 
g > over k, and assume that (A, a) is isomorphic over k to the Jacobian of a 
curve Xq of genus g defined over k. The following alternative holds : 

(i) // Xq is hyperelliptic, there is a curve X/k isomorphic to Xq over k such 
that (A, a) is k-isomorphic to (JacX, j). 

(ii) If Xq is not hyperelliptic, there is a curve X/k isomorphic to Xq over k, 
and a quadratic character 

e : Gal(fc sep /fc) > {±1} 

such that the twisted abelian variety [A, a) e is k-isomorphic to (JacX,j). 
The characters is trivial if and only if (A, a) is k-isomorphic to a Jacobian. 
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Thus, only case (P occurs if g = 1 or g = 2, with all curves being elliptic or 
hyperelliptic. 

1.2. Curves of genus 3. Assume now k C C and g = 3. Let there be given an 
indecomposable principally polarized abclian threefold (^4, a) defined over k. In a 
letter to J. Top [28], J. -P. Serre asked a twofold question: 

— How to decide, knowing only (A, a), that X is hyperelliptic ? 
- If X is not hyperelliptic, how to find the quadratic character e ? 

Moreover, he suggested a strategy in order to compute the twisting factor e. This 
strategy is based on a formula of Klein [20J relating the modular form \18 ( m the 
notation of Igusa), to the square of the discriminant of plane quartics, see Th l4.1.2l 
for a more precise formulation. In [21j . two of the authors justified Serre's strategy 
for a three dimensional family of abelian varieties and in particular determined the 
absolute constant involved in Klein's formula. 

In this article we prove that Serre's strategy can be applied to any abclian thrccfolds. 
More precisely, we take a broader point of view. 

(i) We look at the action of fc-isomorphisms on Siegel modular forms defined 
over k and we define invariants of fc-isomorphism classes of abclian varieties 
over k. 

(ii) Wc link Sicgcl modular forms, Tcichmuller modular forms and invariants. 
Then we derive a proof of Klein's formula based on moduli spaces. 

Once these two goals achieved, Serre's strategy can be rephrased as finding a Siegel 
modular form whose locus has a good multiplicity on the Jacobian locus and then 
using point (JTJ) to distinguish between Jacobians and their twists. For g = 3, the 
form xis fulfills the criterion as can be seen thanks to Klein's formula. On the other 
hand, we show that this is no longer the case for Xh when g > 3. We would like 
to point out that we do not actually need Klein's formula to prove Serre's strategy. 
Indeed we do not need to go the full way from Siegel modular form to invariants 
and could instead use a formula due to Ichikawa relating xis to the square of a 
Teichmiillcr modular form (see Rem. 14.2. 2p . However we think that the connection 
between Sicgcl modular forms and invariants is interesting enough in its own, be- 
sides the fact that it gives a new proof of Klein's formula. 

The paper is organized as follows. In Sj2j we review the necessary elements from 
the theory of Siegel and Tcichmuller modular forms. Only £12.41 is original: we in- 
troduce the action of isomorphisms and see how the action of twists is reflected on 
the values of modular forms. In fJ3J we link modular forms and certain invariants 
of ternary forms. Finally in []3]we deal with the case g = 3. We give first a proof 
of Klein's formula and then we justify the validity of Serre's strategy. Finally wc 
explain the reasons behind the failure of the obvious generalization of the theory 
in higher dimensions and state some natural questions. 

Acknowledgements. We would like to thank J. -P. Serre and S. Meagher for 
fruitful discussions and Y. F. Bilu and X. Xarles for their help in the final part of 
Secl4~3l 



2. Siegel and Teichmuller modular forms 

2.1. Geometric Siegel modular forms. The references are [4], [5], [7], [10]. Let 

g > 1 and n > be two integers and A Sjrl be the moduli stack of principally 
polarized abelian schemes of relative dimension g with symplectic level n structure. 
Let 7T : V „ — > ^g,n be the universal abelian scheme, fitted with the zero section 
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£ ■ A g> „ — ► V g> „, and 

7T O 1 — P*0 1 > A 

* Vg,„/Ag.„ _ 6 "Vg,„/Ag, n 

the rank g bundle induced by the relative regular differential forms of degree one 
on \/g. n over A g .„. The relative canonical bundle over A Si „ is the line bundle 

For a projective nonsingular variety X defined over a field k, we denote by 

nl[X] = F°(X,Q^<g>fc) 

the finite dimensional fc- vector space of regular differential forms on X defined over 
k. Hence, the fibre of the bundle fiy ^ A over A € A gn (fc) is equal to fij^-A], and 
the fibre of u) is the one-dimensional vector space 

u[A] = A 3 nl[A]. 

We put A g = A g i and V g = V 9) i. Let R be a commutative ring and h a positive 
integer. A geometric Siegel modular form of genus g and weight h over i? is an 
element of the i?-module 

S g , h (R)=T(A g ®R,u,® h ). 

Note that for any n > 1, we have an isomorphism 

A g ~A ff ,„/Sp 2ff (Z/nZ). 

If n > 3, as shown in [24] . from the rigidity lemma of Serrc [27] we can deduce 
that the moduli space A g n can be represented by a smooth scheme over Z[f n , l/n}. 
Hence, for any algebra R over Z[£„, l/n], the module S 9i ? l (i?) is the submodule of 

r(A s , n ®z[c„,i/»] R,u® h ) 

consisting of the elements invariant under Sp 2g (Z/nZ). 

Assume now that R — k is a field. If / G S S) fe(fe), A is a p. p. a. v. of dimension 5 
defined over k and a is a basis of [A] , define 

(1) /(A,a) = /(i4)/a®\ 

In this way such a modular form defines a rule which assigns the element f(A, a) 6 fc 
to every such pair (A, a) and such that: 

(i) f(A, Xa) = X~ h f(A, a) for any A G fc x . 

(ii) f{A, a) depends only on the fc-isomorphism class of the pair (A, a). 

Conversely, such a rule defines a unique / G S g /, (fc). This definition is a straight- 
forward generalization of that of Deligne-Serre [5] and Katz [H] if g = 1. 

2.2. Complex uniformisation. Assume R = C. Let 

M g = {t G M s (C) I V = r, Imr > 0} 

be the Siegel upper half space of genus g and F = Sp 2g (Z). As explained in [U §2], 
The complex orbifold A 9 (C) can be expressed as the quotient r\H g where F acts 
by 

M.T^{aT + b)-{cT + d)- 1 if M=(l ^)er. 

The group I? 9 ac ts on H g x C 9 by 

V.(t, z) — (t, z + rm + n) if u = ( m J G Z 2s . 
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If U g = Z 2 f\(H g x C 9 ), the projection 

7T I Ug > Hg 

defines a universal principally polarized abelian variety with fibres 

A T = 7r _1 (r) = C 9 /(Z 9 +tZ 9 ). 
Let j(M, t) = ct + d and define the action of V on H ff x C 9 by 

M.(r, Oi, . . • , %)) = (M.r, *j(M, r)" 1 • . . . , z g )) if M e T. 
The map t j(M, r) 1 : C 9 — > C 9 induces an isomorphism: 

ip M : A T ► A m .t- 

Hence, V g (C) ~ r\U g and the following diagram is commutative: 

T\Ug — ^ Vg(C) 
T\Hg — ^ Ag(C) 

As in p. 141], let 

C = — A ■ • • A = (2i7r) 9 dzi A • • • A dz g e T(W g , u>) 
qi q g 

with (z h ...,z g ) e C 9 and {q l , ...,q g ) = (e 2t7rzi , . . . e 2 "^)- This section of the 
canonical bundle is a basis of o;L4 T ] for all r G H g and the relative canonical 
bundle of V g /M g is trivialized by ( : 

w Ug /H g = A 9 ^u g/Hs - Hg x C • C- 
The group T acts on w Dj / Hj by 

M.{t, C) = (M.r, detj(M, r) • C) if M G T, 

in such a way that 

</>m(Cm.t) = deti(M,r)- 1 C T . 
Thus, a geometric Sicgcl modular form / of weight h becomes an expression 

f(A T ) = /(r) • C®\ 

where / belongs to the well-known vector space R Sj /i(C) of analytic Siegel modular 
forms of weight h on Hg, consisting of complex holomorphic functions 4>(t) on H s 
satisfying 

4>{M.t) = Actj{M.T) h (t>{T) 

for any M G Sp 2g (Z). Note that by Koecher principle [TU1 p. 11], the condition of 
holomorphy at oo is automatically satisfied since g > 1. The converse is also true 
p. 141]: 

Proposition 2.2.1. If f e S gM (C) and r G U g , let 

/(r) = /(A r )/C 8 ' 1 = (2i7r)-» fc /(A r )/(dzi A • • ■ A dz fl )®\ 
T/ien the map f ^ f is an isomorphism Sg ! / t (C)^^>Rg i ^(C). □ 
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2.3. Teichmiiller modular forms. Let g > 1 and n > be positive integers 
and let M ff n denote the moduli stack of smooth and proper curves of genus g with 
symplectic level n structure [5]. Let tt : C g . n — > M gn be the universal curve, and 
let A be the invertible sheaf associated to the Hodge bundle, namely 

For an algebraically closed field k the fibre over C G M giTl (k) is the one dimensional 
vector space X[C] = A ff fi£[C]. 

Let R be a commutative ring and h a positive integer. A Teichmiiller modular form 
of genus g and weight h over R is an element of 

T 9ih {R) = T(M g ®R 1 \ m ). 

These forms have been thoroughly studied by Ichikawa [13], [Ej, [E], [IE]. As in 

the case of the moduli space of abelian varieties, for any n > 1 we have 

M g ~ M s , n /Sp 2g (Z/nZ), 

and M 9j „ can be represented by a smooth scheme over Z[£„, 1/n] if n > 3. Then, 
for any algebra i? over Z[£„, 1/n], the module T 9i h(R) is the submodule of 

r(M s ,„ ® z[Cn ,i /n] i?,A 0h ) 

invariant under Sp 29 (Z/nZ). 

Let C/k be a genus g curve. Let Ai, . . . , X g be a basis of f^[C] and A = Ai A • • ■ A X g 
a basis of A[C]. As for Siegel modular forms in ([T]), for a Teichmiiller modular form 
/ 6 T 9j /j(fc) we define 

f(C,\) = f(C)/\® h ek. 
Ichikawa proves the following proposition: 

Proposition 2.3.1. The Torelli map 9 : M g — ► A g , associating to a curve C its 
Jacobian JacC with the canonical polarization j, satisfies 9*u3 = A, and induces 
for any commutative ring R a linear map 

6* : S g , h (R) = T(A g ® R, u>® h ) > T g , h (R) - F(M ff ® R, \® h ), 

such that [9* f](C) = 9* [f (JacC)]. Fixing a basis A of X[C], this is 

/(JacC, a) = [9*f](C,X) if9*a = \. 

□ 

2.4. Action of isomorphisms. Suppose <f> : (A', a') — > (A, a) is a fc-isomorphism 
of principally polarized abelian varieties, then by definition 

f(A,a)=f(A',(3) 

where [3 t = (j>*(a l ) is a basis of fi^A'] and j3 = fi\ A • • • A /3 S € <jj[A']. If ai, . . . , a' g 
is another basis of Sl^A'] and a' = a[ A • • • A a' g , we denote by 6 GL g (fc) the 
matrix of the basis (/3j) in the basis (a'A. We can easily see that 

Proposition 2.4.1. In the above notation, 

f(A,a)=det(M <t> ) h -f(A',a'). □ 

First of all, from this formula applied to the action of —1, we deduce that, if k is a 
field of characteristic different from 2, then S g ,h(k) = {0} if gh is odd. From now 
on we assume that gh is even and char k =/= 2. 
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Corollary 2.4.2. Let (A, a) be a principally polarized abelian variety of dimension 
g defined over k and f G S g> h(k). Let ai, . . . ,a g be a basis of £l\[A], and put 
a = ai A ■ ■ ■ A ct g 6w[A]. Then the quantity 

f{A) = f(A,a) mod x k xh G k/k xh 

does not depend on the choice of the basis of rij.[A]. In particular f(A) is an 
invariant of the k-isomorphism class of A. □ 

Corollary 2.4.3. Assume that g is odd. Let f G S g _h(k) and <p : A' — > A a non 

trivial quadratic twist. If f(A) ^ then f{A) and f{A') do not belong to the same 
class in k x /k x2 . 

Proof. Assume that <f> is given by the quadratic character e of Gal(A;/A;). Then 
d a = e{a) 9 ■ d, where d = det(M ) G k, cr G Gal(fc/fc). 

Assume that g is odd. Then by our assumption h is even, and d 2 — e{a) 9 dd a G k. 
But d ^ k since there exists a such that e(tr) = —1. Using Prop l2.4~T1 we find that 

f(A,a) = (d 2 ) h / 2 f(A',a'). 

Since d 2 is not a square in k, if f(A) ^ then f{A) and f(A') belong to two 
different classes in k h l 2 jk xh ~ k/k x2 . □ 

Let now (A, a) be a principally polarized abelian variety of dimension g defined over 
C. Let lui, . . . , ojg be a basis of fic[-A] and oj = uj\ A • • • A uj g G w\A\. Let 71, . . . 72 9 
be a symplectic basis (for the polarization a). The period matrix 



vt = [f2i n 2 ] 



' \ Ll>i ■ ■ ■ f Ull s 

J 7l J 72g 



v f U a ■ ■ ■ [ U a , 



belongs to the set "Jl g C M g .2 g (C) of Ricmann matrices, and r = f2 2 1 Oi G H g . 
Proposition 2.4.4. In the above notation, 

Proof. The abelian variety A is isomorphic to Aq = C 9 /VLl? 9 and lu G w[A] maps to 
£ = dz\ A • • ■ l\dz g G wL4o] under this isomorphism. The linear map z t— > fl^ z = z 1 
induces the isomorphism 

tp : A n ► A T = C 9 /{Z 9 + T Z 9 ). 

Let us denote £' = dz[ A ■ • • A dz' g — (2iir)' g C, in u[A T ]. Thus, using Prop l2.4.1| 
Equation (JTJ) and Prop |2.2TTI we obtain 

f{A, uj) = f(A Q , = dct n^ h f(A T: 

= detn^ h f(A T )/e m = (2i 7 r)« fe det0 2 - h /(r)/C 8/l = (2^^^, 

from which the proposition follows. □ 



3. Invariants and modular forms 
In this section k is an algebraically closed field of characteristic different from 2. 
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3.1. Invariants. We review some classical invariant theory. Let F be a vector 
space of dimension n over k. The left regular representation p of GL(F) on the 
vector space = Sym rf (F*) of homogeneous polynomials of degree d on E is given 
by 

p(u) : F(x) i — ► (u ■ F)(x) = F(u _1 :r) 

for u G GL(F), F GXj and x <E E. If C/ is an open subset of X^ stable under p, we 
still denote by p the left regular representation of GL(E) on the fc-algebra 0(U) of 
regular functions on U, in such a way that 

p(V) : $(F) i > (u • $)(F) = • F), 

if u G GL(F), $ G Q(U) and F eU. If ft G Z, we denote by O h (?7) the subspace 
of homogeneous elements of degree /i, satisfying $(AF) = \ h <&(F) for A G fc x and 
F <E U . The subspaces Oh(U) are stable under p. An element $ G Oh{U) is an 
invariant of degree h on U if 

k . $ = $ for every u G SL(F), 

and we denote by lnv/j([/) the subspace of Oh(U) of invariants of degree h on U. 
If \r\Vh(U) 7^ {0}, then M = 0(mod n), since the group fi n of n-th roots of unity is 
in the kernel of p. Hence, if $ G 0(U), and if w and n are two integers such that 
hd = nw, the following statements are equivalent: 

(i) $ G [nv fc (l7); 

(ii) u • <f> = (dot u)~"'(f> for every u G GL(F). 

If these conditions are satisfied, we call w the weight of $. 

The multivariate resultant Res(/i, . . . , f n ) of n forms /i, . . . / n in n variables with 
coefficients in fc is an irreducible polynomial in the coefficients of /i , . . . f n which 
vanishes whenever fi, ■ ■ ■ f n have a common non-zero root. One requires that the 
resultant is irreducible over Z, i. e. it has coefficients in Z with greatest common 
divisor equal to 1, and moreover 

Res(x?\...,4") = l 

for any (di, . . . ,d n ) G N™. The resultant exists and is unique. Now, let F G X f /, 
and denote q±, . . . , q n the partial derivatives of F. The discriminant of F is 

DiscF = c- 1 d Res( ft) ...,g n ), with c„, d = d ((«*-i) n -(-i) n )/«i ) 

the coefficient c„ !( z being chosen according to [28]. Hence, the projective hypersur- 
face which is the zero locus of F G X^ is nonsingular if and only if Disc F ^ 0. The 
discriminant is an irreducible polynomial in the coefficients of F, see for instance 
[H Chap. 9, Ex. 1.6(a)]. From now on we restrict ourselves to the case n = 3, i. e. 
we consider invariants of ternary forms of degree d, and summarize the results that 
we shall need. 

Proposition 3.1.1. If F G X^ is a ternary form, the discriminant 

Disc F = d -(d-l)(d-2)-l . R CS ( 91 , 92j q3 ) 

where <7i, 92, 93 are the partial derivatives of F , is given by an irreducible polynomial 
over Z in the coefficients of F , and vanishes if and only if the plane curve Cf defined 
by F is singular. The discriminant is an invariant of X^ of degree 3(c? — l) 2 and 
weight d{d — l) 2 . □ 

We refer to [5] p. 118] and [5T] for a beautiful explicit formula for the discriminant, 
found by Sylvester. 
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Example 3.1.2 (Ciani quartics). We recall some results whose proofs are given 
in [21j . Let Sym 3 (fe) be the vector space of symmetric matrices of size 3 with 
coefficients in k, and 

G m {x,y,z) =%.m.v, v=(x,y,z), 

the quadratic form associated to m £ Sym 3 (fc). Then 

F m (x, y, z) = G m {x 2 ,y 2 , z 2 ) 

is a ternary quartic, and the map m h- > F m is an isomorphism of Sym 3 (fc) to the 
subspace of F G X4 which are invariant under the three involutions 

cr 1 (x,y,z) = (-x,y,z), a 2 {x,y,z) = (x,-y,z), a s (x,y,z) = (x,y,-z). 

If 

ai 63 b 2 
m = 63 a 2 bi G Sym 3 (fc), 
p2 h a 3 _ 

then 

F m (x, y, z) = aix 4 + a 2 if + a 3 z 4 + 2(b x y 2 z 2 + b 2 x 2 z 2 + b 3 x 2 y 2 ). 
For 1 < i < 3, let Ci = a^a^ — b 2 the cofactor of aj. Then 

Disc F m — 2 40 ai a 2 a 3 (ci c 2 c 3 ) 2 det(m) 4 . 

Note that the discrepancy between the powers of 2 here and in [5TJ Prop. 2. 2.1] 
comes from the normalization by c n _ d . 

3.2. Geometric invariants for nonsingular plane curves. Let E be a vector 
space of dimension 3 over k and G = GL(E). The universal curve over the affine 
space X d = Sym d (E) is the variety 

Y d = {(F,x) eX d x¥ 2 I F{x) = 0}. 

The nonsingular locus of X d is the principal open set 

X3 = (X d ) Disc = {FeX d \ Disc(F) ^ 0} . 

If Y° is the universal curve restricted to the nonsingular locus, the projection is a 
smooth surjective fc-morphism 

vo . yo 

whose fibre over F is the non singular plane curve C p . 

We recall the classical way to write down an explicit fc-basis of ft 1 [Cf] = H°(Cf, f^ 1 ) 
for F G X°(fc) (see p. 630]). Let 

f(x 2 dx 3 — x 3 dx 2 ) f(x 3 dxi — x\dx 3 ) f(xidx 2 — x 2 dx{) 

m = , m = , m = . 

qi Q2 93 

where 91,(72,93 are the partial derivatives of F, and where / belongs to the space 
Xd-3 of ternary forms of degree d — 3. The forms rji glue together and define a 
regular differential form Vf{F) G ^[Gf]. Since dim X,j_3 = {d — l)(d — 2)/2 = g, 
the linear map / i— > rjf(F) defines an isomorphism 

X d - 3 ^[Cf]. 
This implies that the sections 77/ G L(X^, fl}. ,w ) lead to a trivialization 

X ^d-3 ► /X° ' 

An element u G G acts on by 

w • (F, x) — (u ■ F, ux), 
and the projection Y° — > X° is G-equivariant. 



JACOBIANS AMONG ABELIAN THREEFOLDS 



9 



We denote r)i,...,rj g the sequence of sections obtained by substituting for / in 
77/ the g members of the canonical basis of X^-3, enumerated according to the 
lexicographic order, the classical basis of r(X°, fiyo/x )• ^ ne sec tio n 

V = rj\ A • ■ • A i] g 

is a basis of the one-dimensional space r(X^, at), where 

a = A%*f2YO/ x o, 

is the Hodge bundle of the universal curve over X°. For every F G X°, an element 
u G G induces by restriction an isomorphism 

¥>« : Cf > Cu-f, 

which itself defines a linear automorphism ^j* of a. 

For any h G Z, we denote by r(X^, a® h ) G the subspacc of sections s G r(X^, a m ) 
such that 

fu( s ) = s f° r every u G G. 
If a G r(X°, a) and F G X^, we define, in the same way as in Equation {T]), 

s{F,a) = s{F)/a® h . 

Hence, s G r(X°, a®' 1 ) if and only if for all u G G and F G X%, one has 

« S )(F,a)= S (F,a). 

Proposition 3.2.1. The section t] G r(X°,a:) satisfies the following properties. 

(i) If ueG, then 

<p* u r) = dct{u) w °?], with Wo =Q=f G N. 

(ii) Let h > be an integer. The linear map 

$ i ► r($) = $-r] m 

is an isomorphism 

r:lnv g7l (X°) — ^ r(X°,a<^) G . 

Proof. Let it G G. Since dim a: u .i? = 1, there is c(u, F) G k x such that 

«7 7 )(F, n) = c(u, F) • r)(F, rj) = c(u, F). 

and c is a "crossed character" , satisfying 

c(W, F) = e(w, F) c(m', u • F). 

Now the regular function F i— > c(u,F) does not vanishes on X°. By Lemma T3.2.2I 
below and the irreducibility of the discriminant (Prop. I3.1.1[) . we have 

c(u,F) = x(u)(DiscF)"^ 

with x( u ) G fc x and n(u) G Z. The group G being connected, the function n(u) = n 
is constant. Since c(Is,F) — 1, we have (DiscF)™ = x(l3) _1 j and this implies 
n = 0. Hence, c(u,F) is independent of F and x 1S a character of G. Since the 
group of commutators of G is SL/3(fc), we have 

X (u) = dct(u) Wo 

for some wo G Z. It therefore suffices to calculate x( u ) when u = AI3, with A e P. 
In this case u ■ F = \~ d F. Moreover, the section 7?/ is homogeneous of degree —1: 
if A G k x and F G X°, then 

Vf (X- d F)/ Vf (F) = A d , 
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hence, 

( i p* u r,)(F,ri) = \ d 3=det(u) w °. 

This implies 

A 3 ™ = det(u) W0 = X d9 , 

and we have proven (Q). 

Let $ G \rw gh (X° d ) and s = t($) = $ • r/®' 1 , let also w = dgh/3. Then 

(<&8)(F, V ) = <t>(u-F)-(^ uV )(F lV ) h 

= dct(u)- d{9h)/3 ${F) ■ det(u) Woh 
= <Z>(F) = s(F, V ), 

hence, r($) G r(X^, A®' 1 ) 6 . Conversely, the inverse of r is the map s h-> s/n® h , 
and this proves ([E)l. □ 

We made use of the following elementary lemma: 

Lemma 3.2.2. Let f G fcpi, . . . , T„] be irreducible and let g £ k(T\, . . . , T n ) 6e a 
rational function which has neither zeroes nor poles outside the set of zeroes of f. 
Then there is an m G Z and c G k x such that g = cf m . 

Proof. This is an immediate consequence of Hilbert's Nullstellensatz, together with 
the fact that the ring k[T\, . . . , T n ] is factorial. □ 

3.3. Modular forms as invariants. Let d > 2 be an integer and g = (^). Since 
the fibres of Y , — > X d arc nonsingular non hyperelliptic plane curves of genus g, 
by the universal property of M g we get a morphism 

p:X° > M°, 

where Mjj is the moduli stack of nonhyperelliptic curves of genus g and p*\ = a 
by construction. This induces a morphism 

p* : r(M° g ,X m ) ► r(X d ,a® h ). 

Let s G T(M° g ,\ m ). For every F G X d , an element it G G induces an isomorphism 

<y9ti : Ci? > C„._f. 

By the universal property of M°, the diagram 

\ Id \ 



p 



a. > a 



is commutative. Hence 



=P*(s), 

and this means that p*s G T(X d , a® h ) G . Combining this result with Prop l3.2.llfu)l . 
we obtain: 

Proposition 3.3.1. For any integer h > 0, the linear map a = r _1 op* is a 

homomorphism: 

F(M° g ,\® h ) ► lnv g/i (X°) 

such that 

a(f)(F) = f(C F ,(p*)- 1 v) 
for any F G X d and any section f G r(M°, \® h ). □ 
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We now make a link between invariants and Siegel modular forms. Let F £ 
and let r\\, . . . ,r\ g be the basis of regular differentials on Cf denned in Sec l3.2l 
Let 71, . . . "f2g be a symplectic basis of H±(C, Z) (for the intersection pairing). The 
matrix 

n = [fii n 2 ] = : j 

belongs to the set C M ff .2 g (C) of Riemann matrices, and r = f^f^i £ H 9 . 

Corollary 3.3.2. Let f € S 9! / t (C) be a geometric Siegel modular form, f £ R 9j ^(C) 
the corresponding analytic modular form, and $ = o~(6*f) the corresponding invari- 
ant. In the above notation, 



$(F) = (2ztt) 



</'< 



/(r) 
det^Jj 



Proof. Let A = (p*)" 1 ^) and lu = (0*)~ 1 (A). From Prop HU and ED] we deduce 
$(F) = (fl*/)(Cjr,A) = /(JacC ) w). 



On the other hand, Prop l2.L4l implies 

/ (J ac^) = (2^^, 
from which the result follows. 



□ 



4. The case of genus 3 

4.1. Klein's formula. We recall the definition of theta functions with (entire) 
characteristics 



£ = 



£2 



following [2]. The (classical) theta function is given, for r 6 H 9 and z 6 C 9 , by 



(z,t)= Y] (? («+<ri/2)r(n+e 1 /2)+2(r l +e 1 /2)( 2 +£ 2 /2)^ 



The Thetanullwerte arc the values at z = of these functions, and wc write 



0[ 6 ](t) 



(t) 



(0,r). 



Recall that a characteristic is even if £i.£% = (mod 2) and odd otherwise. Let S g 
(resp. U g ) be the set of even characteristics with coefficients in {0, 1}. For g > 2, 
we put h = \S g \/2 = 29- 2 (29 + 1) and 

Xh(r) = {2mf h \{ 9[e](r). 

e£S g 

In his beautiful paper |17j . Igusa proves the following result [loc. cit., Lem. 10 
and 11]. Denote by S140 the modular form defined by the thirty-fifth elementary 
symmetric function of the eighth power of the even Thetanullwerte. Recall that 
a principally polarized abelian variety (A, a) is decomposable if it is a product 
of principally polarized abelian varieties of lower dimension, and indecomposable 
otherwise. 

Theorem 4.1.1. If g > 3, then x/j( t ) £ R-g.fc(C). Moreover, If g = 3 and t £ H3, 

then: 

(i) A T is decomposable if Xis( T ) = £i4o( r ) = 0. 



12 



GILLES LACHAUD, CHRISTOPHE RITZENTHALER, AND ALEXEY ZYKIN 



(ii) A T is a hyperelliptic Jacobian if Xis( T ) — an d Si4o(r) 7^ 0. 

(iii) A T is a non hyperelliptic Jacobian if Xis( T ) 0. □ 

Using Prop. 12.2. 1[ we define the geometric modular form of weight h 

Xh (A T ) = (2iiry h Xk(T)(d Zl A • • • A dz g ) 9h . 

Then Ichikawa [TS], [TCj proved that Xh £ S g .h(Q). For g = 3, one finds 

XiMr) = -(27r) 54 xi 8 (r)(dz 1 A dz 2 A dz 3 )® 18 . 

Now we are ready to give a proof of the following result [301 Eq. 118, p. 462]: 

Theorem 4.1.2 (Klein's formula). Let F be a plane quartic defined over C such 
that Cf is nonsingular. Let ^1,772,773 be the classical basis o/f^CV] and 71, . . - 76 
be a symplectic basis of \Hi(CV,Z) for the intersection pairing. Let 

ff 71 vi ■■• J 78 V 
n = [ft! 2 ] = : : 

\J 71 ■■■ J 76 m> 

be a period matrix of Jac(C) and r = f^^i E H3. Then 



2 28 v ; det(fi 2 ) 



18 ' 



Proof. The Cor l3.3.2l shows that I = a o 6*(xis) is an invariant of weight 54, and 
for any FeXj, 



/(F) = -(27T) 



54 Xis(t) 
det n^ 8 ' 



Moreover Th. I^TTTTTfilT]) shows that 1(F) / for all F E X°. Applying Lem. [3~^2l 
for the discriminant, we find by comparison of the weights that / = cDisc 2 with 
c E C a constant. But if F m is the Ciani quartic associated to a matrix m E Sym 3 (/c) 
as in Example I3.1.2) and if DiscF m ^ 0, then it is proven in [2H Cor. 4.2] that 
Klein's formula is true for F m and c = — 2 28 . □ 



Remark 4.1.3. The morphism 9* defines an injective morphism of graded fc-algebras 
S 3 (fc) = ffifc>oS 3 ,fc(*) > T 3 (fc) = ® h >oT 3>h (k). 

In [Hj, Ichikawa proves that if A: is a field of characteristic 0, then T 3 (fc) is generated 
by the image of S3 (A:) and a primitive Tcichmiiller form ^9 E T3 i g(Z) of weight 9, 
which is not of Siegel modular type. He also proves in [TB] that 

(2) r( X i 8 ) = -2 28 -(M3,9) 2 . 

Th. 14. 1.21 implies that // 3: g is actually equal to the discriminant up to a sign. This 
might probably be deduced from the definition of /^g, although we did not sort it 
out (see also PS Sec. 2.4]). 

Remark 4.1 .4. Besides [33] and [TT] where an analogue of Klein's formula is derived 
in the hyperelliptic case, there exists a beautiful algebraic Klein's formula, linking 
the discriminant with irrational invariants [9l Th.11.1]. 
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4.2. Jacobians among abelian threefolds. Let k C C be a field and let g = 3. 
We prove the following theorem which allows to determine whether a given abelian 
threefold defined over k is fc-isomorphic to a Jacobian of a curve defined over the 
same field. This settles the question of Serre recalled in the introduction. 

Theorem 4.2.1. Let {A, a) be a principally polarized abelian threefold defined over 
k C C. Let lji,u>2,0J3 be a basis of £l\[A] and 71,... 76 a symplectic basis of 
i/ 1 (A,Z) / . in such a way that 

n = [Sit o 2 ] = ; 

is a period matrix of (A, a). Put t = il^^i g H3. 

(i) //Si4o(r) = then (A,X) is decomposable. In particular it is not a Jaco- 
bian. 

(ii) //Si4o(t) 7^ and Xis( T ) = then there exists a hyperelliptic curve X/k 
such that (JacA",j) ~ (A,a). 

(iii) If Xis{t) 7^ then (A, a) is isomorphic to a Jacobian if and only if 

-Xi 8 (A-iA W2 A. 3 ) = (2 7 r)-Ji0 I 
is a square in k. 

Proof. The first and second points follow from Th l4.1.ll and Th ll.l.ll Suppose now 
that (A, a) is isomorphic over k to the Jacobian of a non hyperelliptic genus 3 curve 
C/k. Let F £ I 4 ° be a plane model of C. Using Th l4.1.2l we get that 

-Xis(A, Wl A oj 2 A lo 3 ) = (2^) 54 J t 1 ( 8 ^ r ) ) 18 = 2 28 Disc(^) 2 

so it is a square in k. On the contrary. Cor 1 2. 4.2"! shows that if (A 1 , a') is a quadratic 
twist of a Jacobian {A, a) then the expression 

-/(A',c' 1 A^A^) = (2 7 r) 54 Xl8(T ' } 



det(^) 18 

is not a square. □ 

Remark 4.2.2. Note that one does not really need Klein's formula. Alternatively, 
we could use ^ which also proves that 6*(— xis) is a square. 

Corollary 4.2.3. In the notation of Th \4-.2.1\ the quadratic character e of G'A\(k sev /k) 
introduced in Theorem \l.l.l\ is given by e{a) = d/d a , where 



/ (27r)5 4 Xis(r) 



det(ft 2 ) 18 ' 
with an arbitrary choice of the square root. 

4.3. Beyond genus 3. It is natural to try to extend our results to the case g > 3. 
The first question to ask is 

- Does there exist an analogue of Klein's formula for g > 3 ? 
Here we can give a partial answer. Using Sec l2.3[ we can consider the Teichmullcr 
modular form 9*(xh) with h = 2 9 - 2 (2 9 + 1). In pH Prop.4.5] (see also [29]), it is 
proven that for g > 3 the element 

0*(Xh)/2 2 
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has as a square root a primitive element fi g ,h/2 G T 9j /j/ 2 (Z)- If g = 4, in the 
footnote, p. 462 in |20| we find the following amazing formula 

(3) J^ = c . A{Xf . T(Xf . 

Here r = O^fii, with Q = [Sli SI2] beeing a period matrix of a genus 4 non 
hyperelliptic curve X given in P 3 as an intersection of a quadric Q and a cubic 
surface E. The elements A(X) and T(X) arc defined in the classical invariant 
theory as. respectively, the discriminant of Q and the tact invariant of Q and E 
(see p. 122]). No such formula seems to be known in the non hyperelliptic case 
for g > 4. 

Let us now look at what happens when we try to apply Serre's apporoach for g > 3. 
To begin with, when g is even, we cannot use Cor l2.4.2l to distinguish between 
quadratic twists. In particular, using the previous result, we see that Xh(A,LJk) is 
a square when A is a principally polarized abelian variety defined over k which is 
geometrically a Jacobian. A natural question is: 

- What is the relation between this condition and the locus of geometric 
Jacobians over kl 

Let us assume now that g is odd. As we pointed out in Rem l4.2."2"l the existence of 
the square root is almost sufficient to answer Serre's questions when g = 3. This is 
not the case when g > 3. The proof of the corollary 12.4.31 shows that 

X h {A') = {d 2 f/ 2 x h {A) 

for a Jacobian A and a quadratic twist A' . What enables us to distinguish between 
A and A' when g = 3 is the following: if A is the Jacobian of a curve then Xh(A) is 
a square whereas d 2 is not and h/2 = 9 is odd. However as soon as g > 3, 2 2 9 ~ 3 , 
the power g — 3 being the maximal power of 2 dividing h/2, so it is not enough for 
x(A) to be a square in k to make a distinction between A and A'. It must rather 
be an element of k 23 . 

It can be easily seen from the proof of [Hjl Th.l] that 0*(xh) does not admit a 
fourth root. According to pQ or [30] this implies x h (A) £ k 2 " for infinitely many 
Jacobians A defined over number fields k. So we can no longer use the modular 
form Xh to easily characterize Jacobians over k. So the question is: 

- Is it possible to find a modular form to replace Xh in Serre's strategy when 
9> 3 ? 
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